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CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is related to U.S. Patent Applications Nos. ^of David 

L. Detlefs, Steven K. Heller, and Alexander T. Garthwaite for Garbage-First Garbage 
Collection, of David L. Detlefs for a Concurrent-Marking-Initiation Heuris- 
tic, of David L. Detlefs and Steven K. Heller for Age Segregation for Gar- 
bage Collector, and of David L. Detlefs, Steven K. Heller, and Ross C. Knip- 

pel for Mixing Garbage Collection and Concurrent Marking, all of which were filed on 
the same day as this application. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention concerns computer-program compiling and in particular to 
what has in that discipline come to be referred to as “garbage collection.” 

Background Information 

Garbage collection is the term that has come to be used for the operations by 
which data objects that a program will no longer use are recognized so that the computer 
memory occupied by those objects can be reclaimed for reuse. For the purposes of this 
discussion, the term object refers to a data structure represented in a computer system’s 
memory. Other terms sometimes used for the same concept are record and structure. An 
object may be identified by a reference, a relatively small amount of information that can 
be used to access the object. A reference can be represented as a “pointer” or a “machine 
address,” which may require, for instance, only sixteen, thirty-two, or sixty-four bits of 
information, although there are other ways to represent a reference. 
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In some systems, which are usually known as “object oriented,” objects may have 
associated methods, which are routines that can be invoked by reference to the object. 

An object also may belong to a class, which is an organizational entity that may contain 
method code or other information shared by all objects belonging to that class. In the 
5 discussion that follows, though, the term object will not be limited to such structures; it 
will additionally include structures with which methods and classes are not associated. 

Garbage collection is used almost exclusively in environments in which memory 
can be allocated to some objects dynamically. Not all systems employ dynamic alloca- 
tion. In some computer languages, source programs must be so written that all objects to 
10 which the program’s variables refer are bound to storage locations at compile time. This 
storage-allocation approach, sometimes referred to as “static allocation,” is the policy 
traditionally used by the Fortran programming language, for example. 

Even for compilers that are thought of as allocating objects only statically, of 
course, there is often a certain level of abstraction to this binding of objects to storage 
15 locations. Consider the typical computer system 10 depicted in Fig. 1, for example. Data 
that a microprocessor 1 1 uses and instructions for operating on them may reside in on- 
board cache memory or be received from further cache memory 12, possibly through the 
mediation of a cache controller 13. That controller 13 can in turn receive such data from 
system read/write memory (“RAM”) 14 through a RAM controller 15 or from various 
20 peripheral devices through a system bus 16. The memory space made available to an ap- 
plication program may be “virtual” in the sense that it may actually be considerably lar- 
ger than RAM 14 provides. So the RAM contents will be swapped to and from a system 
disk 17. 

Additionally, the actual physical operations performed to access some of the 
25 most-recently visited parts of the process’s address space often will actually be performed 
in the cache 12 or in a cache on board microprocessor 1 1 rather than on the RAM 14. 
Those caches would swap data and instructions with the RAM 14 just as RAM 14 and 
system disk 1 7 do vshth each other. 
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A further level of abstraction results from the fact that an application will often be 
run as one of many processes operating concurrently with the support of an underlying 
operating system. As part of that system’s memory management, the application’s mem- 
ory space may be moved among different actual physical locations many times in order to 
5 allow different processes to employ shared physical memory devices. That is, the loca- 
tion specified in the application’s machine code may actually result in different physical 
locations at different times because the operating system adds different offsets to the ma- 
chine-language-specified location. 

Some computer systems may employ a plurality of processors so that different 
10 processes’ executions actually do occur simultaneously. Such systems come in a wide 
variety of configurations. Some may be largely the same as that of Fig. 1 with the excep- 
tion that they include more than one microprocessor such as processor 11, possibly to- 
gether with respective cache memories, sharing common read/write memory by commu- 
nication over the common bus 16. 

15 In other configurations, parts of the shared memory may be more local to one or 

more processors than to others. In Fig. 2, for instance, one or more microprocessors 20 at 
a location 22 may have access both to a local memory module 24 and to a further, remote 
memory module 26, which is provided at a remote location 28. Because of the greater 
distance, though, port circuitry 29 and 30 may be necessary to communicate at the lower 
20 speed to which an intervening channel 32 is limited. A processor 34 at the remote loca- 
tion may similarly have different-speed access to both memory modules 24 and 26. In 
such a situation, one or the other or both of the processors may need to fetch code or data 
or both from a remote location, but it will often be true that parts of the code will be rep- 
licated in both places. 

25 Despite these expedients, the use of static memory allocation in writing certain 

long-lived applications makes it difficult to restrict storage requirements to the available 

memory space. Abiding by space limitations is easier when the platform provides for 

dynamic memory allocation, i.e., when the platform enables allocation of memory space 

to be delayed until after the program has been loaded and is already running. 

20/573488.2 
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Dynamic allocation has a number of advantages, among which is that the run-time 
system is able to adapt allocation to run-time conditions; for given objects the program- 
mer can specify respective conditions on which space should be allocated to them. The 
C-language library function mallocQ is often used for this purpose. Conversely, the pro- 
5 grammer can specify conditions under which memory previously allocated to a given ob- 
ject can be reclaimed for reuse. The C-language library function freeQ results in such 
memory reclamation. 

Because dynamic allocation provides for memory reuse, it facilitates generation 
of large or long-lived applications, which over the course of their lifetimes may employ 
10 objects whose total memory requirements would greatly exceed the available memory 
resources if they were bound to memory locations statically. 

Particularly for long-lived applications, though, allocation and reclamation of dy- 
namic memory must be performed carefully. If the application fails to reclaim unused 
memory — or, worse, loses track of the address of a dynamically allocated segment of 
15 memory — its memory requirements will grow over time to exceed the system’s available 

memory. This kind of error is known as a “memory leak.” Another kind of error occurs 
when an application reclaims memory for reuse even though it still maintains a reference 
to that memory. If the reclaimed memory is reallocated for a different purpose, the appli- 
cation may inadvertently manipulate the same memory in multiple inconsistent ways. 

20 This kind of error is known as a “dangling reference,” because an application should not 
retain a reference to a memory location once that location is reclaimed. Explicitly man- 
aging dynamic memory by using interfaces like malloc()/free() often leads to these prob- 
lems. 

Such leaks and related errors can be made less likely by reclaiming memory space 
25 more automatically. As was mentioned above, the software and/or hardware used for this 
purpose is typically referred to as a garbage collector. Garbage collectors operate by in- 
specting the running program’s current state, determining from that state whether it can 
decide that there are some objects that the program can no longer reach, and reclaiming 

objects thus found not to be reachable. The criteria that garbage collectors use for this 
20/573488.2 
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purpose vary, but, for example, a program’s global variables are normally considered 
reachable throughout a program’s life. Although they are not ordinarily stored in the 
memory space that the garbage collector manages, they may contain references to dy- 
namically allocated objects that are, and the garbage collector will consider such objects 
5 reachable. It will typically also consider an object reachable if it is referred to by a refer- 
ence in a register or a thread’s call stack. And reachability is contagious: if a reachable 
object refers to another object, that other object is reachable, too. 

It is advantageous to use garbage collectors because, whereas a programmer 
working on a particular sequence of code can perform his task creditably in most respects 
10 with only local knowledge of the application, memory allocation and reclamation tend to 
require more-global knowledge. A programmer dealing with a small subroutine, for ex- 
ample, may well be able to identify the point in the subroutine beyond which the routine 
has finished with a given memory portion, but knowing whether the application as a 
whole will be finished with it at that point is often much more difficult. In contrast, gar- 
15 bage collectors typically work by tracing references from some conservative notion of a 
“root set,” e.g., global variables, registers, and the call stack: they thereby obtain reach- 
ability information methodically. By using a garbage collector, the programmer is re- 
lieved of the need to worry about the application’s global state and can concentrate on 
(more-manageable) local-state issues. The result is applications that are more robust, 

20 having no dangling references and fewer memory leaks. 

Garbage-collection mechanisms can be implemented by various parts and levels 
of a computing system. One approach is simply to provide them as part of a batch com- 
piler’s output. Consider Fig. 3’s simple batch-compiler operation, for example. A com- 
puter system executes in accordance with compiler object code and therefore acts as a 
25 compiler 36. The compiler object code is typically stored on a medium such as Fig. 1 ’s 
system disk 17 or some other machine-readable medium, and it is loaded into RAM 14 to 
configure the computer system to act as a compiler. In some cases, though, the compiler 
object code’s persistent storage may instead be provided in a server system remote fi’om 
the machine that performs the compiling. The electrical signals that typically carry the 
20/573488.2 
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digital data by which the computer systems exchange that code are examples of the kinds 
of electromagnetic signals by which the computer instructions can be communicated. 
Others are radio waves, microwaves, and both visible and invisible light. 

The input to the compiler is the application source code, and the end product of 
5 the compiler process is application object code. This object code defines an applica- 
tion 38, which typically operates on input such as mouse clicks, etc., to generate a display 
or some other type of output. This object code implements the relationship that the pro- 
grammer intends to specify by his application source code. In one approach to garbage 
collection, the compiler 36, without the programmer’s explicit direction, additionally 
10 generates code that automatically reclaims unreachable memory space. 

Even in this simple case, though, there is a sense in which the application does not 
itself provide the entire garbage collector. Specifically, the application will typically call 
upon the underlying operating system’s memory-allocation functions. And the operating 
system may in turn take advantage of hardware that lends itself particularly to use in gar- 
15 bage collection. So even a very simple system may disperse the garbage-collection 
mechanism over a number of computer-system layers. 

To get some sense of the variety of system components that can be used to im- 
plement garbage collection, consider Fig. 4’s example of a more complex way in which 
various levels of source code can result in the machine instructions that a processor exe- 
20 cutes. In the Fig. 4 arrangement, the human applications programmer produces source 
code 40 written in a high-level language. A compiler 42 typically converts that code into 
“class files.” These files include routines written in instructions, called “byte code” 44, 
for a “virtual machine” that various processors can be software-configured to emulate. 
This conversion into byte code is almost always separated in time from that code’s execu- 
25 tion, so Fig. 4 divides the sequence into a “compile-time environment” 46 separate from a 
“run-time environment” 48, in which execution occurs. One example of a high-level lan- 
guage for which compilers are available to produce such virtual-machine instructions is 
the Java'*''^ programming language. {Java is a trademark or registered trademark of Sun 

Microsystems, Inc., in the United States and other countries.) 

20 / 573488.2 
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Most typically, the class files’ byte-code routines are executed by a processor un- 
der control of a virtual-machine process 50. That process emulates a virtual machine 
from whose instruction set the byte code is drawn. As is true of the compiler 42, the vir- 
tual-machine process 50 may be specified by code stored on a local disk or some other 
5 machine-readable medium from which it is read into Fig. 1 ’s RAM 14 to configure the 
computer system to implement the garbage collector and otherwise act as a virtual ma- 
chine. Again, though, that code’s persistent storage may instead be provided by a server 
system remote from the processor that implements the virtual machine, in which case the 
code would be transmitted by electromagnetic signals to the virtual-machine- 
10 implementing processor. 

In some implementations, much of the virtual machine’s action in executing these 
byte codes is most like what those skilled in the art refer to as “interpreting,” so Fig. 4 
depicts the virtual machine as including an “interpreter” 52 for that purpose. In addition 
to or instead of running an interpreter, many virtual-machine implementations actually 
15 compile the byte codes concurrently with the resultant object code’s execution, so Fig. 4 
depicts the virtual machine as additionally including a “just-in-time” compiler 54. 

The resultant instructions typically invoke calls to a run-time system 56, which 
handles matters such as loading new class files as they are heeded and includes much of 
garbage-collector implementation. The run-time system will typically call on the services 
20 of an underlying operating system 58. Among the differences between the arrangements 
of Figs. 3 and 4 in that Fig. 4’s compiler 40 for converting the human programmer’s code 
does not contribute to providing the garbage-collection function; that results largely from 
the virtual machine 50 ’s operation. 

Independently of the specific system-architecture levels at which the collector re- 
25 sides, garbage collection usually includes some amount of reference tracing to determine 
whether objects are at least potentially reachable; if they are not potentially reachable, 
they are garbage, and their memory space can therefore be reclaimed. The most straight- 
forward and accurate way to do the tracing is to start at the root set and scan recursively 

for referred-to objects until all have been identified. If an object is not encountered in 
20/573488.2 
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that process, it is not reachable, even if it is referred to by a reference in some other ob- 
ject. 

Now, it would be unacceptable in many applications to have the mutator pause 
while the collector traces references through the whole heap. So some garbage collectors 
5 perform the tracing in threads of execution that (mostly) operate concurrently with the 
mutator. They mark the objects thereby encountered, and, with possibly with some ex- 
ceptions, objects that remain unmarked at the end of the marking operation can be recog- 
nized as garbage. Since the most of the marking operation executes concurrently with 
mutator execution, this limits pause times. It is still expensive, though, and it can slow 
10 mutator execution. 

Another solution is for the garbage collector to operate “space-incrementally.” In 
each successive collection increment, which typically (but not necessarily) is all per- 
formed during a single pause in mutator execution, the collector considers a small por- 
tion, or collection set, of the heap. For respective regions of the heap, the collector keeps 
15 track of the references that refer directly to objects in those regions. A collection-set ob- 
ject can be recognized as unreachable if no reference chain from such a reference in- 
cludes it. This approach can often limit pause time adequately without the complexity of 
requiring the collector to operate concurrently with the mutator, although some incre- 
mental approaches nonetheless do employ some concurrent operations. 

20 Although the space-incremental approach has therefore acquired considerable 

popularity, it imposes a certain overhead. As was just mentioned, it involves keeping 
track of the references that refer directly into respective heap regions. To avoid an ex- 
haustive tracing operation for each increment, this is accomplished by using write barri- 
ers: when a mutator writes a reference, it has to perform additional steps to inform the 
25 garbage collector of where it has done so. 
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SUMMARY OF THE INVENTION 

I have devised a way of reducing this overhead. In accordance with my approach, 
the garbage collector reserves some heap regions for objects that it has found to be 
“popular,” i.e., to which it has observed a large number of references. When the mutator 
5 writes such a reference, it refrains from making the kind of notification to which the gar- 
bage collector would otherwise respond by updating a remembered set. Although this 
deprives the garbage collector of the ability to maintain complete remembered sets for 
popular-object regions, those regions usually have no unreachable objects or very few, so 
the collector can dispense with collecting them or can collect them less frequently, in a 
10 way that does not rely on remembered sets. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The description below refers to the accompanying drawings, of which: 

Fig. 1 is a block diagram that illustrates a typical computer system in which the 
present invention’s teachings may be practiced; 

15 Fig. 2 is a block diagram of a multiprocessor computer system, which can also use 

the present invention’s teachings; 

Fig. 3 is a block diagram that illustrates the relationship between a compiler and 
the resultant application program; 

Fig. 4 is a block diagram that illustrates another way in which source code can re- 
20 suit in an executing program; 

Fig. 5 is a simplified flow chart of a collection increment; 

Fig. 6 is a time-line diagram depicting the interposition of collection pauses 
within marking operations 

Fig. 7 is a flow chart of a marking operation; 

25 Fig. 8 is a flow chart of an object-scanning routine that the marking operation of 

Fig. 7 employs; 

Fig. 9 is a flow chart of a polling routine also employed by the operation of Fig. 8; 
20/573488.2 
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Fig. 10 is a flow chart depicting the routine that results when a compiler that tar- 
gets the illustrated embodiment encounters source code calling for a reference to be writ- 
ten; 

Fig. 1 1 is a flow chart of one of the write barriers included in the Fig. 10 routine; 

5 Fig. 12 is a flow chart of an operation performed by the routine of Fig. 1 1 to in- 

form the garbage collector of a reference that has been overwritten; 

Fig. 13 is a flow chart of a routine that the illustrated embodiment’s garbage col- 
lector employs to adjust its marking operation in response; 

Fig. 14 is a flow chart that depicts the way in which the collector processes entries 
10 in a list of marked objects to be scanned; 

Fig. 15 is a flow chart that depicts a cleanup routine that the eollector performs at 
the end of its marking operation; 

Fig. 16 is a flow chart of another write barrier executed by a mutator that writes a 
reference; 

15 Fig. 1 7 is a flow chart depicting a routine included in the write barrier of Fig. 16; 

Fig. 18 is a flow chart depicting an operation that a remembered-set-updating 
thread executed by the collector performs; 

Fig. 19 is a flow chart of the way in which the illustrated embodiment collects 
certain “popular-pending” heap regions; 

20 Fig. 20 is a flow chart depicting an operation employed in that routine to deter- 

mine objects’ popularities; 

Fig. 21 is a flow chart of an object-evacuation routine that the illustrated embodi- 
ment employs; 

Fig. 22 is a flow chart showing how the illustrated embodiment identifies regions 
25 to which non-popular objects should be evacuated; 

Fig. 23 is a flow chart of a routine employed by the Fig. 21 operation to apprise 
marking threads of certain object evacuations; and 

Fig. 24 is a flow chart depicting the way in which the illustrated embodiment de- 
termines when to initiate a new marking cycle. 

20/573488.2 
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DETAILED DESCRIPTION OF AN ILLUSTRATIVE 

EMBODIMENT 

The present invention can be implemented in a wide range of garbage collectors. 
Many such garbage collectors will treat the heaps that they manage as being divided into 
5 generations. Initial allocation for new objects will typically occur in a “young” genera- 
tion, where mortality is expected to be high, i.e., where in many programs most objects 
soon become unreachable. The young-generation objects whose longevity nonetheless 
proves to be high are typically promoted into an “older” generation: they are moved to a 
part of the heap occupied by such longer-lived objects. When such a garbage collector 
10 implements the teachings to be set forth below, it may implement them in less than all 
generations, or it may implement them in every generation. 

Although, as was just stated, the invention can be implemented in multiple- 
generation collectors, we prefer to implement it in a single-generation collector. The dis- 
cussion below therefore describes the invention’s features by reference to such a collec- 
15 tor. For the sake of concreteness, we will assume that the collector is provided, as was 
mentioned above, as part of a virtual machine. 

In discussions of garbage collection, the portion of a program that performs the 
operations specific to the program’s main purpose (e.g., word processing, telephone-call 
routing, etc.) is referred to as the mutator, from the collector’s point of view, the muta- 
20 tor’s function is to modify the reference graph on which the collector operates. The col- 
lector will typically have to interrupt the mutator from time to time to perform certain of 
its tasks. 

Consider a “copying” collector, for instance, of which the collector about to be 
described is an example. The copying approach is used in order to keep heap fragmenta- 
25 tion low. To enable it to reclaim relatively large blocks of contiguous space, a copying 
collector often evacuates potentially reachable objects from among unreachable objects, 
i.e., copies them to other locations so that the memory that they originally occupied can 

20/573488.2 
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be reclaimed with the memory occupied by the unreachable objects. Although many of 
the collector’s tasks can be performed by, say, a collector thread that executes concur- 
rently with the mutator, evacuation does not lend itself readily to concurrent perform- 
ance; references to the evacuated objects need to be updated, and a mutator that attempts 
5 to access an object between the time when that object is evacuated and the time when ref- 
erences to that object are updated to reflect its new location is likely to exhibit unpredict- 
able behavior. So most copying collectors interrupt the mutator at least for evacuation. 

Unfortunately, a mutator pause long enough for a complete collection is often un- 
acceptable; telephone-company subscribers would find a several-second pause in a call- 
10 switching program annoying, for instance. So collectors, including the one about to be 
described, often operate space-incrementally: they operate in increments in each of which 
they consider only a relatively small heap portion, called a collection set, and identify un- 
reachable objects in the collection set without necessarily tracing the entire reference 
graph from the root set. For example, we describe below one way in which the collector 
15 can, without tracing references throughout the entire heap, determine for each collection- 
set object whether it is referred to from outside the collection set, and a group of objects 
within the collection set can be considered unreachable if none of the group’s members is 
referred to directly by any root or any reference in an object not in the group. (As will 
also be seen below, the illustrated collector will additionally employ other criteria for 
20 concluding that objects are unreachable.) 

To implement space-incremental collection, the collector treats the heap that it 
manages as being divided into heap regions, among which it selects to form the collec- 
tion set for each collection increment. For the sake of concreteness we will consider the 
example of a collector that employs a single standard region size, since the resultant sim- 
25 plicity of region identification will make this a typical approach. The collector maintains 
metadata for each region, for purposes that will become apparent below. If an object lar- 
ger than the standard region size needs to be allocated, the illustrated embodiment tempo- 
rarily increases to some integral number of normal-region sizes the size of the region in 

20 / 573488.2 
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which the object to be allocated begins. Also, for reasons to be discussed in due course, 
the illustrated embodiment places any object larger than three-quarters of the standard 
region size in its own region: no other object is placed in a region thus occupied. 

At various points during mutator operation a decision will be made that a collec- 
5 tion increment needs to be performed. Although the particular decision criterion is not 
germane to the present discussion, the decision is usually based to some extent on how 
much space the mutator has allocated since the last collection increment, or on how much 
heap space is left. In any event, the collector at that time selects the regions that will con- 
stitute the collection set. In some types of spaee-incremental collectors the regions se- 
10 lected are the “oldest,” i.e., the ones in which the objects were first allocated the longest 
time before. This approach has a certain appeal, since doing so gives the region contents 
the longest time to “die” before a collection. This can make the collection relatively effi- 
cient: the amount of space reclaimed in a given collection should be large. Even though a 
given region has the most garbage, though, choosing it for collection may not be the best 
15 choice. 



To understand this, consider Fig. 5, which is a simplified flow chart of a region’s 
collection. As was mentioned above, an object is reachable if there is a reference to it in 
the root set, which typically includes non-heap locations such as registers, call stacks, 
static variables, etc. So block 60 represents identifying references in the root set that re- 
20 fer to objects in the collection set, evacuating to non-collection-set regions the objects 
thus referred to, and recursively evaeuating to such regions any followers, i.e., any collec- 
tion-set references referred to from objects thus evacuated. 

Note that the block-60 operation does not necessarily evacuate all reachable col- 
lection-set objects. In order to contain cost, that operation traces reference chains from 
25 only those root-set references that refer directly to collection-set objects; it does not ex- 
haustively traee reference chains that may have led from root-set references though other 
regions to those in the collection set. To ensure that collection-set objects reachable 

through such chains are not left in the collection set and their space thereby reclaimed, 
20/573488.2 
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the collector performs the operation that block 62 represents: it determines whether there 
are any collection-set objects referred to from objects in non-collection-set heap regions. 

For that purpose, the metadata for each region include a “remembered set.” As 
will be explained in more detail below, a remembered set is a list of all locations that at 
5 some time contained references into that region. If they previously contained such refer- 
ences, they may still, so the collector scans the thus-identified locations for references 
into the collection set. Now, the object containing a reference thus found may itself be 
garbage, so the collection-set object that it refers to may be, too. But, unless in an opera- 
tion represented by block 64 the collector finds that it has further information, of a type to 
10 be described below, on which it can base a conclusion that the object definitely is gar- 
bage, the collector will evacuate a thus-referred-to object and its followers, as block 66 
indicates, making the conservative assumption that the referred-to object is not garbage. 
Any objects not thus evacuated definitely are garbage, though, so all of the collection 
set’s memory space can be reclaimed for re-allocation, as block 68 indicates. 

15 One aspect of Fig. 5 that is relevant to collection-set selection is the search for 

cross-region references that block 62 represents. As was just explained, the collector 
uses the collection-set member regions’ remembered sets for this purpose. Since a re- 
membered set, as was also just explained, is a list of locations where references into the 
region have been observed, remembered-set sizes — and the attendant cost of scanning 
20 them — can vary greatly among regions. So, even if a region is old and is therefore likely 
contain a lot of garbage, the best choice may be not to include it in the collection set if its 
remembered set is large. Consequently, the illustrated embodiment does not simply 
choose the oldest regions for collection-set membership. Instead, it makes a selection 
that is based in part on remembered-set size. 

25 But remembered-set size is not the only factor that the illustrated embodiment 

takes into accoxmt in arriving at collection-set membership. Another factor is the amount 
of garbage likely to be collected. And, although it is often true that the oldest regions 

tend to contain the most garbage, there are counterexamples. So, for at least some of the 
20/573488.2 
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regions, the illustrated collector employs what we refer to as a “garbage-first” approach 
in determining whether to include them in the collection set. In accordance with this ap- 
proach, the collector employs a garbage-content estimate that is not based simply on re- 
gion age. In the illustrated embodiment, this involves employing a full-heap marking, 

5 most of which is preferably performed concurrently with mutator execution, to arrive at a 
minimum-garbage-content value for each of the older regions. 

One way of using this information is to compute an expected efficiency value for 
at least some of the regions that are candidates for inclusion in the collection set. For ex- 
ample, the cost of a collection pause may be estimated by, say, 

V{cs) = V^,,,^U-d + ^ (5 • rsSize(r) + C • UveBytes(r)) 

10 recs ^ 

where V(cs) is the cost of collecting collection set cs, Vf,xed represents fixed costs common 
to all pauses, d is the number of remembered-set-log-buffer entries (explained below) 
needed to be scanned to update the remembered sets before using them, U is the average 
cost per entry, S is the cost per entry of scanning a remembered set, rsSize(r) is the num- 
15 ber of entries in the remembered set maintained for region r, C is the cost per byte of 
evacuating and scanning a live object, and HveBytes(r) is an estimate of how many live 
bytes region r contains. The efficiency of a given collection set’s collection may be 
computed as the ratio of the garbage estimate (e.g., the difference between the collection- 
set size and the estimated number of live bytes) to the cost, and the regions can be chosen 
20 to maximize this efficiency. As will be seen below, there are sometimes regions for 

which the marking mentioned above results in no minimum garbage-content value, so the 
illustrated embodiment uses an age-based estimate for those regions. 

We now discuss how the illustrated embodiment performs the marking on which 
it bases its garbage estimates. In the marking operation the collector traces the reference 
25 chains from all roots, “marking” as reachable each object encountered in the process. As 
those skilled in the art are aware, there are many ways to mark an object. For example, 
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an object’s format may include a header field that indicates whether the object was found 
to be reachable in the last marking. In the illustrated embodiment, though, the collector 
employs a marking bitmap separate from the objects thereby marked. For every heap lo- 
cation at which an object can start in accordance with the system’s alignment policy, the 
5 marking bitmap includes a corresponding bit that indicates whether a reachable object has 
been found to start at that location. If the system’s alignment policies dictate that objects 
can start only at byte addresses ending in OOO 2 , for example, the size of the marking bit- 
map will be 1/64 that of the heap. (Actually, for reasons that will presently become ap- 
parent, the illustrated embodiment employs two such marking bitmaps.) 

10 Some embodiments that employ marking may simply stop the mutator and, while 

the mutator is stopped, perform all the tracing and marking. But the resultant pause may 
be too long in some applications, so the illustrated embodiment instead performs much of 
the marking concurrently with mutator operation: as one or more mutator threads are 
executing, one or more marking threads may be tracing references and marking referred- 
15 to objects. 

Fig. 6 is a time line that shows how marking may be interleaved with other collec- 
tor operations, and it shows that a marking may span several collection increments. The 
first interval has an “NM” legend to indicate that no marking is in progress and that the 
mutator is not otherwise interrupted. This does not mean that the collector is idle, 

20 though. As will be seen, for example, the garbage collector may perform remembered-set 
maintenance concurrently with mutator operation. In a multiprocessor environment, this 
may mean that the mutator is executing on one or more of the processors simultaneously 
with the collector’s remembered-set-maintenance operation on one or more other proces- 
sors. 



25 The next, “PC” interval represents a pause for collector copying. During this in- 

terval, the mutator is interrupted so that the evacuations and accompanying reference up- 
dates are atomic with respect to mutator activity. A non-marking (“NM”) interval then 

occurs, during which the mutator again executes. At some point a decision is made to 
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perform a marking, and, as will be explained further below, a pause for mark start-up 
(“PMS”) occurs, during which the mutator does not execute. Most marking activity is 
concurrent, though, and the next interval represents concurrent marking (“CM”), during 
which the mutator can execute. Again, the concurrent operations may be taking place in 
5 different processors simultaneously in a multiprocessor enviromnent. 

As subsequent intervals indicate, that marking and the concurrent mutator execu- 
tion may be interrupted from time to time for collector-copying pauses (“PC”). Eventu- 
ally, the marking operation will require other threads to pause (“PMB”) to complete its 
inspection of information left it, as will be explained below, by so-called write barriers 
10 that the mutator threads execute. Some more concurrent marking (“CM”) then occurs, 
after which the marking ends with a pause for marking clean-up (“PMC”), during which 
mutator threads are again suspended. 

The purpose for marking reachable objects is to identify garbage objects by proc- 
ess of elimination; if an object’s location is not marked, it is garbage. So, in the operation 
15 mentioned above in connection with Fig. 5’s block 64, the illustrated embodiment’s col- 
lection operation relies on the marking operation’s results to avoid evacuating garbage 
objects. Yet the process of elimination just mentioned presupposes that the marking has 
been completed, whereas, as the time line indicates, the mutator and collection operations 
can be executing while the marking operation is still in progress. Additionally, the muta- 
20 tor and copying operations modify the reference chains that the marking operations 
trace — while the marking threads are in the process of tracing them. 

There are a number of ways in which an embodiment that employs concurrent 
marking can deal with these complications. The particular way in which the illustrated 
embodiment deals with the first complication, namely, that the marking operation is 
25 sometimes incomplete while the mutator and copying operations are in progress, is to 
employ two marking bitmaps, which we refer to as “previous” and “next” marking bit- 
maps. As will be explained below in more detail, the previous bitmap contains the marks 

for the last completed marking, while the next bitmap contains any marks for a marking 
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that is still in progress or has not yet started. The mutator and collection operations rely 
only on the previous bitmap for identifying garbage objects, but they also update the next 
bitmap to help an in-progress marking to proceed, as will presently be discussed. 

Now, some objects may have been allocated since the previous marking, so the 
5 fact that the previous marking did not mark a given object does not necessarily mean that 
the given object is garbage. But an unmarked object that was already allocated at the be- 
ginning of the previous marking is necessarily garbage. To take advantage of this fact, 
the illustrated embodiment keeps track of where objects had already been allocated when 
the previous marking began. Part of the approach that it uses to do this is to allocate 
10 space in each region contiguously, beginning at one end of its address range (the region’s 
“bottom”) and filling toward its other end. Additionally, it includes in each region’s 
metadata a previous-top-at-mark-start field, which (with some exceptions that will be de- 
scribed below) identifies the location to which allocation in that region had reached when 
the previous marking began. In the illustrated embodiment, the region’s bottom is the end 
15 having the lower address value. So, in the test that Fig. 5’s block 64 represents, the col- 
lection operation concludes that an object is unreachable if its address is less than the 
contents of its region’s previous-top-at-mark-start field and its bit in the previous- 
marking bitmap does not have the reachability-indicating value (I 2 in the illustrated em- 
bodiment). 

20 Fig. 7 illustrates how the illustrated embodiment carries out this approach. 

' Block 70 represents setting all of the next-marking bitmap’s contents to zeros to indicate 
that the marking about to commence has not yet found any objects to be reachable. The 
marking operation begins with references in the registers, call stacks, etc., so the marking 
operation needs to be able to recognize which contents are references. To this end, it 
25 calls upon all threads to suspend themselves, as block 72 indicates, and they do so at 
“safe points,” i.e., at instructions for which the compiler has created stack maps that tell 
which stack and register contents contain references. As block 74 indicates, it marks all 
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locations referred to by the root-set references thus identified: it sets to I 2 the correspond- 
ing bits in the next-marking bitmap. 

As was mentioned above, the current marking will, when it is completed, be reli- 
able as to all objects still located where they were when the marking started. As was also 
5 mentioned above, each region’s metadata also include a field that tells where the top was 
when the last completed marking started. This is the previous-top-at-mark-stait field. 

For allocation purposes, each region’s metadata also include “top” field to identify the 
location to which space in that region has been allocated so far. To recall the value to be 
placed in the previous-top-at-mark-start field when the current marking is eventually 
10 completed, the marking operation performs the block-76 operation of copying each re- 
gion’s top value into another metadata field, its next-top-at-mark-start field. 

Having thus completed its use of the stack maps and recorded the values that the 
regions’ tops had at the start of the marking, the marking operation signals the mutator 
threads to resume execution, as block 78 indicates. Most of the marking operation then 
15 proceeds concurrently with mutator execution. 

In the illustrated embodiment, the marking operation’s concurrent part comprises 
beginning at the bottom of the next-marking bitmap, as block 80 indicates, and proceed- 
ing upward, as block 82 indicates, to find each bit location that contains the reachability- 
indicating value (I 2 in the illustrated embodiment). That value means the corresponding 
20 heap location contains the head of a reachable object. When it finds such a location, it 
records the corresponding heap location in a “finger” variable that it maintains for this 
purpose, and, as block 84 indicates, it takes the first step in tracing the reference chain 
from each reference contained by the object whose head is at that location. Specifically, 
it scans the referent object in an operation that Fig. 8 depicts. 

25 As Fig. 8’s block 86 indicates, the scanning operation includes considering each 

of the references in the object being scanned. For each such reference, the marking 
thread determines, as block 88 indicates, whether the object referred to has already been 
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marked. If it has not, the marking thread marks it and then, as will now be explained, en- 
sures that any reference-graph sub-tree of which that object is the root gets traced. If the 
referent’s address is higher than the finger value, then the marking operation of Fig. 7 
will encounter it in due course and attend to tracing its sub-tree, so the thread does not 
5 need to take any further action to ensure tracing from that object. If the reference’s value 
is less than the finger value, on the other hand, the marking thread pushes the reference 
value onto a mark stack, as block 94 indicates. As Fig. 7’s block 96 indicates, the mark- 
ing operation includes “draining” the mark stack by, as will be explained below, tracing 
reference chains from the references that the stack contains. 

10 Before we discuss mark-stack draining, though, we return to Fig. 8, in which 

block 98 indicates that the illustrated embodiment performs a polling operation each time 
it scans an object. Fig. 9 depicts that polling. Fig. 9’s block 100 represents polling a 
“should pause” flag, which gets set by, e.g., a collection thread that needs other threads to 
pause for a collection interval. As block 101 indicates, the marking thread suspends itself 
15 if that flag has been set. Independently of whether it has, the marking thread also — 
possibly after having resumed execution — ^tests another, “process marking buffers” flag, 
as block 102 indicates. To understand that flag’s meaning, it is necessary to digress to a 
discussion of “write barriers.” 

Remember in this connection that the marking operation’s purpose is to detect 
20 garbage by taking a snapshot of the object-reference graph as it stood at the beginning of 
the marking; if, when marking began, there was no reference chain from the root set to an 
object that was in existence at that time, then that object is garbage. Since the marking 
operation traces those reference chains concurrently with mutator operation, though, the 
mutator can change a reference field that the marking operation has not yet processed. 

25 Now, for the mutator thus to have accessed that reference field, the object to which its 
previous contents referred was necessarily reachable when the concurrent marking began, 
so the reference-graph sub-tree of which it is a root was, too. Moreover, that sub-tree 
may still be reachable after that field’s contents are changed. For example, the mutator 
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could have copied the previous contents into a register — which the marking operation 
does not revisit after the marking operation’s initial, non-concurrent part. If the marking 
operation consisted simply of simply tracing from the directly reachable objects, though, 
it could miss that sub-tree and thereby allow it to appear unreachable. 

5 To avoid this possibility, a compiler targeting a system that employs the illus- 

trated garbage collector will, in response to source code that calls for a reference-write 
operation, emit a write barrier, i.e., emit object code that communicates to the marking 
thread that such a write operation has occurred. Fig. 10 illustrates the operation that code 
emitted by the compiler may prescribe, its block 104 represents the write barrier used for 
10 marking support, and Fig. 1 1 depicts that writer barrier. 

The mutator needs to communicate with the marking operation only if there is one 
in progress, so the write barrier tests for that condition, as Fig. 1 1’s block 106 indicates. 
This test may be performed on the value of a global variable that the marking thread tog- 
gles at the beginning and end of a marking, but there may be some value in having the 
15 marking thread instead toggle a similar flag in each mutator thread’s execution environ- 
ment. In any event, if a marking operation is currently in progress, the write barrier reads 
the value that the target reference field contains before the update, and, as block 108 indi- 
cates, it determines whether that value is NULL, i.e., whether it is a distinguished value, 
typically zero, indicating that the reference refers to no object at all. If it is, the field does 
20 not contain the root of a reference chain, so the mutator does not need to apprise the 
marking thread of that field’s change. Otherwise, as blocks 108 and 110 indicate, the 
write barrier places the original reference-field value in a buffer containing a list of such 
values. 



Fig. 12 depicts in more detail the operation that Fig. 1 1’s block 1 10 represents. 

25 The illustrated embodiment minimizes inter-thread contention by having each mutator 
thread’s metadata include a pointer to a marking buffer to which no other mutator thread 
writes and, ordinarily, the marking thread does not have access. If that thread-specific 

buffer becomes full, though, the mutator thread places it on a global completed-marking- 
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buffer list, as blocks 112 and 114 indicate. This is a common list, protected by a lock, to 
which all mutator threads add their completed buffers. 

When that list becomes long enough, the marking thread needs to read it. So, as 
block 1 16 indicates, the mutator determines whether adding its buffer has made that list’s 
5 length reach a predetermined threshold. If it has, the mutator sets a flag that the marking 
thread checks in the operation mentioned above in connection with Fig. 9’s block 104. 
Block 1 1 8 represents setting that flag. 

Independently of whether the threshold was reached, the mutator thread allocates 
a new thread-local marking buffer, as block 120 indicates, if it added the previous one to 
10 the common list. And, in any event, the mutator adds the reference field’s previous value 
to its marking buffer, as block 122 indicates. As Fig. 10 ’s block 124 indicates, the muta- 
tor then updates the field that was the target of the reference-vsrite operation. 

We now return to Fig. 9, which represents the polling operation that the marking 
thread performs in the course of tracing reference chains. If the test that block 102 repre- 
15 sents determines that the mutator threads have completed enough marking buffers, then 
the marking thread processes those buffers. Block 126 represents that operation, which 
Fig. 13 illustrates. As blocks 128, 130, 132, and 134 indicate, the marking thread consid- 
ers the entries in each buffer in the list in turn until it has processed all of them. For each 
entry, the marking thread marks the referred-to object if it is not already marked, as 
20 blocks 136 and 138 indicate. And, as blocks 140 and 142 indicate, it places on the mark 
stack the address of any object it thus marks if that object’s address is less than the finger 
value. 



With the polling operation of Fig. 9 completed. Fig. 8’s object-scanning operation 
ends, and the marking operation illustrated in Fig. 7 proceeds to drain the mark stack, as 
25 that drawing’s block 96 indicates and Fig. 14 illustrates in more detail. As Fig. 14’s 
blocks 146 and 148 indicate, that operation repeatedly pops references from the mark 
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stack until none is left. And, as block 150 indicates, it scans each referred-to object in the 
manner described above in connection with Fig. 8. 

As Fig. 7’s blocks 82, 84, and 96 indicate, the concurrent part of the marking op- 
eration continues until the top of the next-marking bitmap has been reached and the mark 
5 stack has been drained. At that point, some entries may still remain in completed mark- 
ing buffers as well as in (thread-specific) marking buffers that are not yet full. That is, 
there may still be some reference-field contents that were in existence at the marking’s 
start but that the marking operation has not yet considered. To make sure that it has taken 
a complete snapshot, the marking operation signals all mutator threads to suspend them- 
10 selves, as block 154 indicates. As block 156 indicates, it then processes all of the mark- 
ing buffers as before, with the exception that it additionally processes the marking buffers 
that are not yet full and that therefore have not been added to the completed-marking- 
buffer list. Since this results in mark-stack entries, the mark stack is then drained again, 
as block 1 58 indicates. 

15 Flaving thus completed marking all objects that were live at the beginning of the 

marking operation, the marking thread can determine a maximum for the number of live 
bytes in each region. It starts with a zero-live-byte value for each region. Then, for each 
marked bitmap entry, it adds the size of the corresponding object to the live-byte total for 
the region in which that object starts. This operation can largely be performed concur- 
20 rently with mutator operation. As blocks 160 and 162 indicate, therefore, the marking 
thread signals the mutator threads to resume execution before it starts counting live bytes. 

When the concurrent live-byte counting has been completed, the mutator needs to 
perform a final, cleanup operation with the mutator threads suspended, as blocks 164 
and 166 indicate. Fig. 15 depicts the cleanup operation. As was explained above, collec- 
25 tor copying can interrupt the marking thread’s concurrent operations. Typically, a collec- 
tor-copying operation includes the collector’s copying reachable objects into some re- 
gions above what had been those regions’ tops. As will be seen, the evacuation operation 

includes moving the evacuated objects’ marks with the objects. And, in contrast with the 
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mutator’s operation of allocating objects in new-allocation regions, the collector’s opera- 
tion of evacuating objects into evacuation regions includes, for reasons that will become 
apparent in due course, raising those regions’ next-top-at-mark-start values. If this hap- 
pens during the concurrent counting that Fig. 7’s block 162 represents, the maximum- 
5 live-byte value will have changed. So the marking thread completes the live-byte count 
while other threads are suspended, as Fig. 15’s block 168 indicates. 

In the process, the marking thread may encounter regions for which the maximum 
number of live bytes is zero, i.e., regions that are all garbage. Those regions can be re- 
claimed forthwith, without evacuating reachable objects, so the marking thread does so, 

10 as block 170 indicates. (Incidentally, this is the only way in which the illustrated em- 
bodiment reclaims regions occupied by objects larger than three-quarters of a normal re- 
gion size. As was mentioned above, such objects are allocated respective exclusive re- 
gions, and the illustrated embodiment never includes such regions in the collection sets.) 

With a maximum-live-byte count determined for the regions that contained ob- 
is jects at the beginning of the marking operation, the marking thread can make the effi- 
ciency estimates mentioned above, and it can therefore sort the regions by their respective 
estimated collection efficiencies, as block 172 indicates. The regions whose estimated 
efficiencies are highest will be considered for membership in the collection set when the 
time thereafter comes for a copying collection. When that time comes, efficiency esti- 
20 mates will be updated for these regions to take into account changes in remembered-set 
size, and the resultant efficiencies are used as the basis for the final collection-set selec- 
tion. 

Having thus completed the actual marking and live-byte counting, the marking 
thread swaps the values in the fields that contain the pointers to the previous- and next- 
25 marking bitmaps: the next-marking bitmap becomes the previous-marking bitmap. For 
each region, it also adopts the next-top-at-mark-start value as the previous-top-at-mark- 
start value. Block 174 represents performing those operations, after which, as Fig. 7’s 
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block 176 indicates, the mutator operation signals the suspended threads to resume. This 
completes the marking operation. 

When the collection set has been selected for a given collection increment, its 
constituent regions are collected: the potentially reachable objects are evacuated, and the 
5 regions are claimed for reuse. In the collection increments, the collector evacuates ob- 
jects only if they are not demonstrably unreachable. Objects that were not found to be 
reachable in the previous marking are clearly unreachable, so the collector does not 
evacuate them. But an object that was reachable at the last completed marking may be- 
come unreachable in the interim; the reference(s) that made it reachable at the time of the 
10 marking may since have been overwritten to point elsewhere. Such an object can be 
identified as garbage if no reference outside the collection set refers to it directly or 
through other collection-set objects. As was mentioned above, the collection increment 
does not include scarming all references outside the collection set to make this determina- 
tion. Instead, its scanning of the heap for this purpose is limited to locations that “re- 
15 membered sets” associated with the collection-set regions identify as having contained 
references to the respective regions’ objects. We now turn to the maimer in which the 
remembered sets are maintained. 

As was explained above in connection with that Fig. lO’s block 104, a mutator 
thread that writes a value in a heap reference location often records that location’s previ- 
20 ous value so that the collector can use it for marking purposes. To assist in remembered- 
set maintenance, the mutator thread often additionally records the reference location it- 
self. Fig. lO’s block 178 represents a write barrier for that purpose, and Fig. 16 illustrates 
that write barrier. 

Now, the purpose that a given region’s remembered set serves is only to list loca- 
25 tions in other regions where references to the given region’s objects have been found. So 
there is no need to record reference locations that contain NULL values, since they con- 
tain no valid references. As will be explained below, moreover, there are some, “popu- 
lar-object” regions for which the illustrated embodiment does not maintain remembered 
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sets, so the locations of references to objects in those regions do not have to be recorded. 
And, since remembered sets list only inter-region references, not intra-region references, 
intra-region references’ locations require no recording, either. As Fig. 16’s blocks 180, 
181, and 182 indicate, the write barrier therefore tests for those conditions and bypasses 
5 reference-location recording if any of them prevails. The following pseudocode is an ex- 
ample of instructions that a compiler may emit for this purpose after a write operation 
that copies a value from rY into a field at offset FieldOffset in an object located at the ad- 
dress contained by register rX: 

1 rTmp := rX XOR rY 

2 rTmp := rTmp » LogOfHeapRegionSize 

3 // Below is a conditional move instruction; 

4 if (rTmp == 0) goto filtered 

5 rTmp := POPULAR_OBJECT_BOUNDARY 

6 if (rY < rTmp) goto filtered 

7 call rs_enqueue(rX) 

8 filtered: 

The first two lines determine whether the referent and reference-containing object 
are in the same region. If they are, the fourth line causes the fifth- through seventh-line 
instructions to be skipped. Otherwise, the mutator thread determines whether the refer- 
ence refers to a location in a popular-object region. In the illustrated embodiment, it does 
this by determining whether that location is below a popular-object-region boimdary, as 
the fifth and sixth lines indicate. If the referent is indeed in a popular-object region — or 
if the reference is NULL — the thread skips the seventh-line instruction. Otherwise, it 
executes that instruction, which tells the collector that a reference has been written and 
where the writing occurred. 

In the illustrated embodiment, the way in which the collector keeps track of where 
references have been written is to use a card table. The collector considers the heap to be 
divided for this purpose into cards of, say, 512 bytes each, and the card table includes for 
each card an entry that indicates whether a cross-region reference has been written in that 
30 card since the last remembered-set update. As block 183 indicates, the mutator thread 
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determines whether the entry for the reference’s card already indicates that the card is 
“dirty,” i.e., whether a reference has been written there. If so, the entry does not have to 
be changed. 

Otherwise, the card-table entry needs to be set to the dirty-indicating value. The 
5 collector does this in an operation that block 184 represents and Fig. 17 depicts in detail. 
Block 1 86 represents actually placing that value in the card table, and the remaining op- 
erations are directed to facilitating the work of a thread that concurrently updates remem- 
bered sets in response. To this end, the illustrated embodiment provides each mutator 
thread with a dedicated log in which it lists the cards whose entries it has found to need 
10 revision. 

The illustrated embodiment employs fixed-size buffers to contain the threads’ re- 
spective dedicated remembered-set logs, and Fig. 17’s block 188 represents determining 
whether the thread’s log buffer is full. If it is, the mutator needs to allocate a new buffer. 
Before it does so, though, it places the full buffer on a global list of such buffers, to 
15 which all mutator threads add their full remembered-set-log buffers. 

Although not apparent in Fig. 5, collection operations will typically involve some 
use of those buffers to update the remembered sets before the search for inter-heap-region 
references, which that drawing’s block 62 represents. To limit the amount of such work 
that the collection operation has to do, the illustrated embodiment provides a remem- 
20 bered-set-updating thread to update the remembered sets by processing the global list’s 
entries, in a marmer that will be discussed in due course, concurrently with mutator op- 
eration. But the mutator may occasionally update references at a pace that is too fast for 
the remembered-set-updating thread: if that thread were to handle the between-collection- 
interval remembered-set updating alone in such cases the amount of remembered-set up- 
25 dating remaining at the beginning of a collection pause would make the pause too long. 

So the mutator thread tests for this condition, as Fig. 17’s block 190 indicates, and, as 
block 1 92 indicates, it processes the buffer on its own, in a maimer that will become ap- 
parent below, if the buffer list is too long. Otherwise, as block 194 indicates, it adds its 
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buffer to the global list. This may involve contention with other threads, but that conten- 
tion should occur only infrequently. 

Now, a small amount of that updating during collection pauses is acceptable, so 
the collector’s concurrent remembered-set-updating thread does not begin execution until 
5 the global list includes a minimum number of buffers. When the list reaches that mini- 
mum, the mutator thread informs the remembered-set-updating thread it has, and 
Fig. 17’s block 196 represents doing so. 

As was mentioned above, the mutator has to allocate a new buffer if its previous 
buffer was full, and block 198 represents that operation. Independently of whether it was 
10 necessary to allocate a new buffer, the mutator adds the card to the list in the current 
buffer, as block 200 indicates. 

When a mutator signals the remembered-set-updating thread that the list of re- 
membered-set logs requires processing, the remembered-set-updating thread begins a 
concurrent remembered-set-updating operation, which Fig. 18 depicts. Basically, the re- 
15 membered-set-updating thread considers all cards identified by entries in any of the listed 
buffers, as block 204 indicates. When it considers a card, its first action is to set the cor- 
responding card-table entry to the “clean” value, as block 206 indicates, so that the muta- 
tor will record any further reference- write operations that take place in that card after the 
remembered-set-updating thread begins scanning the card. As block 208 indicates, it 
20 scans the card for references. In the illustrated embodiment, space within the card may 
have been so allocated that parsing the card for reference locations will be particularly 
time-consuming. If that happens, the remembered-set-updating thread avoids expending 
the time that parsing would require. Instead, it simply considers the scanning operation 
unsuccessful and marks the card dirty again, as blocks 210 and 212 indicate, and pro- 
25 ceeds to the next card. 

We digress at this point to mention that some embodiments may employ an ap- 
proach to implementing remembered-set logs that avoids the parsing problem and may 
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therefore be considered advantageous in some cases. Whereas the illustrated embodi- 
ment records the modified reference’s location coarsely, by making an entry identifying 
only the card in which it (or, say, the head of the object that contains it) is located, some 
embodiments may instead use a sequential-store buffer that logs the head of the object 
5 containing the reference or even the reference’s address. The remembered-set-update 
thread in such an embodiment does not need to perform all of the parsing required of the 
illustrated embodiment’s. Of course, such an arrangement makes it necessary for the 
write barrier to make entries more frequently. But a way of containing this effect to an 
extent is for each mutator thread to maintain some small number of cache fields for re- 
10 membering the locations where the heads of the objects containing the most-recently 
modified references are located. In place of the operation represented by Fig. 16’s 
block 183, such an embodiment would check the cache value to determine whether the 
reference being modified is in the same object as the last cross-region reference modified 
by that thread. If it is, the write barrier refrains from logging it, because the remembered- 
15 set-updating thread will scan that object for all its references anyway. 

In the illustrated embodiment, though, that thread has to parse the card, and in 
most cases it succeeds. It can therefore determine whether the card contains any refer- 
ence locations that the thread has not yet scanned. Block 214 represents making that de- 
termination. If there are none, the thread returns to the buffer list to determine whether 
20 the listed buffers contain any entries that it has not processed. As block 216 indicates, it 
otherwise makes an entry, if necessary, in a remembered set for the region that contains 
the object to which the card’s next reference refers, and it increments an entry count 
maintained for that remembered set. 

As was observed above, an entry will not be necessary if the reference and the ob- 
25 ject to which it refers are located in the same region. Additionally, the illustrated em- 
bodiment implements remembered sets as hash tables, which facilitate determining 
whether an existing reference location has already been recorded in the remembered set. 

If it has, then the remembered-set-updating thread does not enter it. 
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The remembered-set-updating thread then determines whether the region’s refer- 
ence count has reached a region-“popularity” threshold, as block 218 indicates. Before 
we discuss the reason for doing so, recall that the mutator’s write-barrier routine depicted 
in Fig. 17 can itself include, as that drawing’s block 192 indicates, processing a buffer 
5 essentially in the manner that the remembered-set-updating thread does. Moreover, while 
it is intended that most of the remembered-set updating be performed concurrently with 
mutator operation, some of it will be performed at the beginning of a collection pause. 

For both of these reasons, there will be times at which more than one thread will be per- 
forming the updating. To avoid the cost of dealing with contention among these threads 
10 for access to the remembered sets, the illustrated embodiment maintains a plurality of 
remembered sets for each of the regions, and each thread concurrently performing updat- 
ing claims a different one of each region’s remembered sets to which to add entries. So, 
to determine the region’s popularity, the thread totals the entry counts for all of the re- 
gion’s remembered sets. 

15 If a region’s count exceeds a predetermined threshold, the illustrated embodiment 

infers that the region may be on its way to having an excessively large remembered set, 
one that will make collection and continued maintenance expensive. The remembered- 
set-updating thread therefore steps in to avoid much of that cost before the remembered 
set becomes too large. Specifically, it adds the region to a list of “popular-pending” re- 
20 gions, as block 220 indicates, and sets a flag in response to which a special collection in- 
crement will in due course be performed. 

Fig. 19 depicts such a special collection increment’s salient features. Whereas the 
garbage collector makes the collection-set selection in most collection increments in ac- 
cordance with the efficiency ordering described above, it makes that selection in special 
25 increments from one or more of the regions on the popular-pending list, as block 224 in- 
dicates, independently of whether other regions, not on the list, will result in more- 
efficient collection. 
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Another difference from other collection pauses is that the special collection in- 
cludes a preliminary pass through the collection-set regions’ remembered sets to deter- 
mine whether any of its objects are particularly popular. For each collection-set object, 
that is, it counts how many references refer to it. For this purpose the illustrated em- 
5 bodiment temporarily allocates a “shadow region” for each collection-set region and 
keeps a count for each collection-set object in the location corresponding to the one in 
which that objects begins. Block 226 represents the popularity-determining operation, 
which Fig. 20 depicts in more detail. 

As blocks 228 and 230 indicate, the collector proceeds through all of the entries 
10 until it has completed that first pass through all of them. As block 232 indicates, the col- 
lector determines for each remembered-set entry whether the object containing the refer- 
ence in the location thereby identified is “live with respect to the previous marking.” It 
considers an object live with respect to the previous marking if (1) the object is marked 
explicitly in the previous-marking bitmap or (2) it is implicitly marked in the sense that 
15 its address is above the previous-top-at-mark-start value for the region containing that 
object. An object that is not live with respect to the previous marking can reliably be 
concluded to be unreachable, so a reference that such an object contains does not cause 
the collector to increment any collection-set object’s reference count. 

If the reference-containing object is not thereby found to be unreachable, the col- 
20 lector next determines, as block 234 indicates, whether the reference refers to a collec- 
tion-set object. If it does, the collector increments the object’s reference count, as 
block 236 indicates. In the illustrated embodiment, multiple conciurent threads perform 
the counting operation, so they use atomic compare-and-swap operations for reference- 
count incrementing. 

25 Having finished the reference-count operation, the collector makes another pass 

through the collection set. In that pass, as Fig. 19’s block 238 indicates, it evacuates to 
special, popular-object regions the collection-set objects whose reference counts exceed a 

popular-object threshold. As was mentioned above in connection with Fig. 16’s 
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block 181, the illustrated embodiment does not maintain remembered sets for objects lo- 
cated in such regions, so a remembered-set write barrier can simply return without re- 
cording the write operation if it finds that the written reference refers to an object located 
in such a region. As the write-barrier pseudocode above indicated, the write barrier’s de- 
5 termination of whether the object is located in a popular-object region can be made easily 
if, as in the illustrated embodiment, allocation is so arranged that all addresses below a 
certain address value are reserved for popular objects. 

We digress at this point to note that the illustrated embodiment never collects the 
popular-object regions; once it identifies an object as popular, it never reclaims the mem- 
10 ory occupied by that object. This is acceptable in most programs, since objects that at 
some point become popular rarely become unreachable thereafter. Still, some implemen- 
tations may provide for reclaiming once-popular objects’ memory, and this can be done 
without maintaining remembered sets for popular-object regions and thereby suffering 
the attendant write-barrier overhead. At the end of the heap-wide marking, for example, 

15 the collector can sweep the popular-object regions for unmarked objects. It can do so 
concurrently with mutator execution, and, if it does not additionally compact the popular- 
object regions, it can simply add the unmarked objects’ memory blocks to a free list, also 
concurrently with mutator execution. 

When the collector has evacuated all popular objects, it scans each object thus 
20 evacuated for references to other collection-set objects. In a manner that will be de- 
scribed below in connection with Fig. 21, it evacuates to normal regions any objects 
thereby referred to. As Fig. 19’s block 240 indicates, the collection operation then pro- 
ceeds generally as was described in connection with Fig. 5. 

Fig. 21 shows how the illustrated embodiment performs the object-evacuation op- 
25 eration that Fig. 5’s block 66 represents. Block 242 represents determining whether the 
referred-to object has already been evacuated. When an object is evacuated in the illus- 
trated embodiment, a field in the location from which it was evacuated is given a value 

indicating that the object was evacuated and identifying the location to which the evacua- 
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tion occurred. If that field indicates that the object has already been evacuated, it is not 
evacuated again, but the reference that triggered execution of the Fig. 21 operation is up- 
dated, as block 244 indicates, to reflect the referred-to object’s new location. That block 
also represents adding the reference’s location to the remembered set of the region that 
5 contains the object unless the reference is itself in that region or that region is a popular- 
object region. 

If the object has not been evacuated, on the other hand, it will need to be. 

Block 248 represents doing so, in an operation that Fig. 22 depicts in detail. Now, it has 
been observed in a wide range of programs that the “old” objects, i.e., objects that have 
10 survived several collections, tend to survive more collections. Even though the illustrated 
embodiment chooses collection sets predominantly in accordance with expected collec- 
tion efficiency rather than age, we have recognized that there still is some value in segre- 
gating old objects into their own regions; doing so tends to make the other regions’ col- 
lections more efficient. To support such age segregation, the illustrated embodiment in- 
is eludes in each region’s metadata an age field, which is the subject of a test that Fig. 22’s 
block 250 represents. 

A region’s age field is determined by the objects it has been selected to receive. 

In the illustrated embodiment, some regions, to which we will refer as “mutator- 
allocation regions,” are selected to receive only objects that the mutator has newly allo- 
20 cated, while other regions, to which we will refer as “GC-allocation regions,” receive 
only objects that the collector has evacuated. Unless memory is at a premium, no region 
contains both types of objects at the same time. 

The mutator-allocation regions are assigned an age value of zero, to indicate that 
they contain only objects that have not yet survived any collections. When the collector 
25 evacuates an object from such a region, that object’s “age” has increased to one: it has 
survived one collection. To implement age segregation, the collector evacuates such an 
object to a GC-allocation region whose age field indicates that it contains only one- 

collection-old objects. The receiving-region metadata’s age field may already contain 
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that age value, or, if the object is the first that the receiving region has received since it 
was last reclaimed, be given that by the collector in the process of copying the evacuated 
object. 



When the collector is instead collecting a GC-allocation region, it similarly copies 
5 the evacuated objects into regions whose age values are one greater than the ages of the 
(GC-allocation) regions from which they were copied. This may be subject to em age 
limit, as Fig. 22 indicates by imposing an age limit of two. Specifically, block 250 de- 
termines whether the source region’s age value is already two. If it is, the destination re- 
gion’s age value will also be two, as block 251 indicates. As block 252 indicates, the 
10 destination region’s age value is otherwise one greater than the source region’s. 

Block 253 represents copying the object to a region whose age is the one thus deter- 
mined. Again, if heap space is at a premium, the collector may adopt a different mode, in 
which it permits age mixing within regions. 

The collector then updates the reference to identify the object’s new location, as 
15 Fig. 21 ’s block 256 indicates, and makes any necessary remembered-set update as a re- 
sult. It also performs an operation, represented by block 258, in which the evacuating 
thread apprises any marking threads of what it has done. To appreciate the reason for this 
operation, consider the following situation. An object is being evacuated from a location 
that it occupied at the beginning of a marking that was interrupted by the collection pause 
20 in which the evacuation occurs. The object is being evacuated because it was live at the 
begirming of the previous marking and an inter-region reference still refers to it. But 
suppose it actually has become unreachable — i.e., the object containing the reference to it 
is itself unreachable — and in fact was already unreachable at the begirming of the current 
(interrupted) marking. In its original region, it would therefore have been recognized as 
25 unreachable if that region’s collection did not occur until the current marking was com- 
pleted. In its new region, though, the object’s location is above the one that the new re- 
gion’s next-top-at-mark-start value identified when the current marking began; it is im- 
plicitly marked. Without more, it would therefore be considered live in the new region 
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after the current marking is completed, even though it became unreachable before that 
marking started. 

To avoid this result, the collector performs an operation, represented by Fig. 5’s 
block 260, of so adjusting the next-top-at-mark-start value for each region into which it 
5 has evacuated objects that they are not marked implicitly. But this means that evacuated 
objects that are live with respect to the current marking have to be explicitly marked. 

This is the purpose served by the operation that Fig. 21’s block 258 represents. 

Fig. 23 illustrates that operation. As that drawing’s block 262 indicates, no action 
needs to be taken if no marking is currently in progress. Otherwise, the collector deter- 
10 mines whether the evacuated object is live with respect to the marking currently in pro- 
gress, i.e., whether it is marked in the next-marking bitmap (explicitly marked) or located 
above its source region’s next-top-at-mark-start location (implicitly marked). If its previ- 
ous location is thereby determined to have been explicitly or implicitly marked with re- 
spect to the interrupted marking, the collector marks its new location with respect to that 
15 marking; as blocks 264 and 266 indicate, it sets the next-marking bitmap’s bit that corre- 
sponds to the object’s new location. As blocks 268 and 270 indicate, the collector addi- 
tionally places the object’s new location in the mark stack in that case if the object was 
moved from above the finger to below it; otherwise, the evacuation could prevent the ob- 
ject’s sub-tree from being traced. 

20 These steps preserve partial-marking information across the collection pause and 

avoid the result mentioned above. If the evacuated object was unreachable at the start of 
the current marking, it will be unmarked in its new location, too, and, because the next- 
stop-at-mark-start value has been raised above that object’s address, that object will be 
recognized as garbage if its new region is collected when the current marking has been 
25 completed. 

Now, this way of apprising the marking thread of the evacuation may appear to 
depend on using the approach, mentioned above, of employing a given region only for 
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evacuation or only for new-object allocation but not for both. In GC-allocation regions, 
that is, the next-top-at-mark-start value is increased when an object is added, whereas it 
stays the same when an object is added in a mutator-allocation region. With a minor re- 
finement to the block-266 operation, though, the within-region mixing that may be per- 
5 mitted in some implementations when memory is low can readily be accommodated. 

Specifically, the collector can first compare the region’s next-top-at-mark-start 
value with its “top” value, i.e., with the value in the region’s metadata field that indicates 
where the next object should be placed. From the foregoing description, it can be appre- 
ciated that these values will ordinarily be the same for GC-collection regions but will of- 
10 ten be different for mutator-allocation regions. If they differ for a region into which the 
collector is evacuating objects, then mixing is occurring. But the collector can still pre- 
serve the partial-marking information by taking into account the fact that the newly allo- 
cated objects must be live with respect to the marking currently in progress: before it in- 
crements the next-top-at-mark-start value by the evacuated object’s size, it can mark the 
15 bitmap bits for all locations whose addresses lie between the top value and the (not-yet- 
incremented) next-top-at-mark-start value. 

This completes the discussion of the operation, represented by Fig. 21’s 
block 258, in which the collector apprises the marking thread of the object’s evacuation. 
After it has done so, it recursively evacuates the object’s followers, as blocks 274 
20 and 276 indicate. 

We now return to the manner in which the illustrated embodiment deals with in- 
teractions between the evacuating and marking operations. If the collection interrupted a 
marking operation, that operation’s mark stack may contain references to collection-set 
locations, so the collection-set reclamation can make those entries stale. As Fig. 5’s 
25 block 280 indicates, one way to address this is to update those entries. That is, the collec- 
tor could identify all mark-stack entries that refer to collection-set locations, update those 
that refer to locations from which objects have been evacuated, and set the others to 

NULL. 
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An alternative, and one that we prefer, is not to perform a separate operation of 
the type that block 280 represents. Instead, we treat the mark stack as a source of roots in 
the root-processing operation of block 60. We precede that operation by one, not shown 
in Fig. 5, in which we process all of the marking buffers, including the incomplete thread- 
5 local ones, to make sure that all overwritten references have been marked and, if neces- 
sary, their scanning scheduled. Since in this approach the collection-set referents of all 
mark-stack entries are necessarily evacuated as part of root-set processing, a separate up- 
dating operation of the type that block 280 represents is urmecessary. 

In any event, the illustrated embodiment further provides for interaction between 
10 the marking and collecting by including in the block-68 operation a step in which the 
marking-bitmap bits corresponding to all reclaimed collection-set locations are reset in 
both bitmaps. 

We now turn briefly to the manner in which the illustrated embodiment ordinarily 
selects collection sets. As was explained above, that selection is ordinarily based on each 
15 candidate region’s expected collection efficiency, and that in turn is based on an estimate 
of the number of live bytes in the region. As was also explained above, the expected 
number of live bytes is inferred fi'om a maximum-live-byte value that results from the 
marking operation. This value is most reliable for regions that were completely allocated 
at the beginning of the previous marking. It is less reliable for others, since any object 
20 not allocated when that marking started is marked implicitly, so the marking operation is 
not effective at identifying such objects as unreachable. For such regions, the collector 
may instead base its live-byte estimate on, say, the number of allocated bytes and some 
measure of the region’s age. While the particular way in which the live-byte estimate is 
made for such regions is not germane to the invention, one way involves starting with a 
25 configured relationship between live-byte rate and age and then refining it by experience. 
For example, a live-byte rate for age-zero regions can be estimated as part of the collec- 
tion process. As objects are evacuated, a count of the number of evacuated bytes can be 
kept for each such region. The average number of live bytes in the collection set’s age- 
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zero regions can then be calculated, and the estimate used in efficiency calculations can 
be updated with the result by, for instance, computing an exponential average over time. 

Then, as the efficiencies are ranked for the pre-existing regions, i.e., for the re- 
gions whose estimates from the marking operation are considered more reliable, their ef- 
5 ficiency estimates are compared with the estimates for the regions that were not pre- 
existing. When that ranking reaches pre-existing regions for which the estimates are 
lower than for the non-pre-existing ones, the non-pre-existing regions begin to be se- 
lected. 



Although the marking operation’s results are beneficial, a marking operation is 
10 expensive, so it will be best in most applications not to have marking operations in pro- 
gress all the time. Decisions therefore have to be made regarding when to perform the 
marking. One way is simply to pick some number of collection pauses and begin a new 
marking operation each time that many pauses have taken place. Another is to trigger a 
marking operation when the application reaches a point in its execution known not to be 
15 very demanding in its use of resources. Other approaches have also been suggested. In 
addition to or instead of such approaches, we propose to base the marking-initiation deci- 
sion on an efficiency criterion. 

The illustrated embodiment implements this approach in a way that we believe 
tends to result in optimum use of the marking information. Let us call a given marking 
20 and all collection activity that occurs between when it starts and when the next marking 
starts a marking cycle. The illustrated embodiment implements the efficiency-based ap- 
proach by evaluating a cumulative efficiency over a marking cycle. Although different 
embodiments may use different efficiency metrics, efficiency can in general be defined as 
the ratio of how much memory is reclaimed to what it costs to reclaim it. In most cases, 

25 it will be computed as ratio of a number of bytes reclaimed to some measure of the time 
used to reclaim them. 
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The illustrated embodiment’s time-cost computation begins when a marking op- 
eration does. In a processor-operation context, of course, there is more than one way to 
measure time, but most ways are adequate for this purpose. In the particular case of the 
illustrated embodiment, each interval of duration t during which the marking operation 
5 holds other operations’ threads suspended is considered to impose a cost of nt on an n- 

processor system. For other, concurrent-operation intervals, the illustrated embodiment 
considers marking cost to be the amount of processor time the marking threads consume. 
Other embodiments may omit certain processor-time elements from the cost because ac- 
counting for them is not worth the additional accuracy or because they use otherwise-idle 
10 processor time and can therefore be considered “free.” In any event, the sum gives a 
value T that can be considered the cost of the marking operation itself. 

As was mentioned above, the marking interval includes reclaiming regions in 
which it has marked no objects. When the garbage collector uses the type of marking- 
operation triggering here described, that reclamation operation includes counting the 
15 number of garbage bytes thereby reclaimed. For each such region, the difference be- 
tween the region’s starting address and the address indicated by the top value, where the 
next object would have been placed, can be used as the number of garbage bytes re- 
claimed from that region. The collector totals those values to arrive at the marking opera- 
tion’s garbage-reclamation total G. 

20 Some embodiments may use that value divided by the total marking-operation 

time T as the cumulative-efficiency value for the end of the marking operation. As will 
be seen, a more-exact measure may be to include in G in the amount of memory re- 
claimed during collection pauses that occur between the times when the marking opera- 
tion begins and when it ends and to include in T the time required for those pauses and 
25 any other collection activity, such as the concurrent-remembered-set-updating operations. 
Some embodiments may therefore take those factors into account, too, in determining the 
cumulative efficiency. 
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The collector then re-computes the efficiency value each time a collection incre- 
ment occurs. As was mentioned above, different embodiments may base their decisions 
to initiate collection increments on different criteria. For the sake of concreteness, 
though, let us assume that the routine called by the monitor to allocate heap space in- 
5 eludes determining whether the amount allocated so far but not reclaimed has reached a 
threshold and triggering a collection increment if it has. The threshold may, for example, 
be a fixed configured value or some fraction of the total heap size. Additionally, some 
embodiments may use a higher threshold when a marking is in progress and a lower one 
between markings, the theory being that the collection will be more efficient immediately 
10 after the marking, when the best candidate for collection can be identified most accu- 
rately, than during marking, when the previous marking’s results are the most stale. 

In any event, the collector keeps track of how many bytes it has evacuated from 
each collection-set region. When it has evacuated all potentially live objects, it can then 
calculate the cumulative efficiency and determine whether to trigger a new marking cy- 
15 cle. Fig. 24 depicts one way of making that determination. In the Fig. 24 operation, 
which can be thought of as part of the operation of Fig. 5 ’s block-66 reclamation opera- 
tion but may in fact be dispersed throughout the collection operation, the collector con- 
siders each collection-set region in turn, as block 300 indicates. For each one, it calcu- 
lates the number of garbage bytes it is reclaiming from that region and adds that number 
20 to the total garbage g for the collection increment as a whole, as block 302 indicates. 

This continues, as block 304 indicates, until it has considered all the collection-set re- 
gions and has thereby completed computing the collection increment’s total garbage-byte 
count g. With this value determined, it computes a new value G„ew for the marking cy- 
cle’s collection and also updates the marking cycle’s total collection cost T„ew, as 
25 block 306 indicates. 

The cumulative efficiency will in most applications be relatively low initially, be- 
cause the marking operation will usually be expensive whereas the amount of garbage in 
garbage-only regions usually will usually be low. For a while thereafter it will usually 
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improve as the collector incorporates further collection increments’ results in it. So the 
basis on which the illustrated embodiment makes its decision is that, when a marking op- 
eration has been completed, the marking cycle that it starts should continue — i.e., no new 
marking operation should commence — so long as that cycle’s cumulative efficiency is 
5 increasing. When the efficiency does turn dovra — or, in some embodiments, merely fails 
to improve — the collector starts a new marking cycle. 

The theory behind this approach can be understood by postulating a program run- 
ning on a steady-state basis. Under that assumption, all marking cycles have essentially 
the same efficiency if the strategy for triggering marking operations is based on cumula- 
10 tive efficiency and the same criterion is used each time. Since all cycles have the same 
efficiency, that efficiency is the collection efficiency of the overall program. So, if the 
collector initiates a collection when the marking cycle’s cumulative efficiency is at a 
peak, it optimizes the collection efficiency for the program as a whole. 

Fig. 24’s blocks 308, 310, and 312 represent implementing this criterion, with a 
15 minor variation. Although one can imagine situations in which the cumulative efficiency 
initially starts high and almost immediately deteriorates, the illustrated embodiment is 
based on the theory that a dip in cumulative efficiency in any of the first few collection 
intervals is much more likely to be indicative merely of an isolated pathological collec- 
tion increment, not of a longer-term trend in the marking cycle’s efficiency. As 
20 block 308 indicates, the illustrated embodiment therefore triggers the start of a new mark- 
ing cycle only if the current increment is not one of the first few in the cycle. 

The present invention reduces not only write-barrier overhead in the mutator but 
also the cost of maintaining and processing remembered sets. It thus constitutes a sig- 
nificant advance in the art. 

25 What is claimed is: 
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